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Abstract 


Theoretical  and  experimental  research  was  proposed  on  topics  of  strategic  impor¬ 
tance  in  electronic  imaging  with  an  emphasis  on  problems  of  basic  research 
significance  which  also  have  relevance  to  novel  systems  for  imaging,  automatic 
pattern  recognition,  and  remote  sensing.  Our  goal  has  been  to  make  contributions 
in  imaging  science  that  will  lead  to  a  better  understanding  of  hybrid  systems 
combining  optical  imaging,  photosensors,  and  digital  computers  for  signal  process¬ 
ing.  In  the  statement  of  work  we  had  proposed  research  on  three  related  topics.  First, 
we  proposed  to  study  the  controlled  blurring  caused  by  an  idealized  point  spread 
function,  i.e.,  the  random-walk  or  speckle-like  psf.  This  novel  method  for  controlled 
blurring  appears  to  be  useful  in  secure  transmission  and  in  image  compression;  and 
this  psf  has  many  interesting  mathematical  properties  that  we  have  investigated. 
Secondly,  we  proposed  a  study  of  image  recovery  in  the  Fresnel-zone  (incoherent 
case)  when  the  imaging  system  is  misfocused.  We  applied  modern  coherence 
theory  together  with  current  computer-science  techniques  in  order  to  obtain  optimal 
recovery  and,  as  well,  to  establish  theoretical  limits  on  the  image  quality  of  the 
restoration.  In  this  research  we  also  established  an  operator-independent  method 
for  the  identification  of  the  focusing  errors.  For  the  third  topic,  we  had  intended  to 
continue  with  the  remote  sensing  of  particulates  to  include  extension  of  the  inversion 
theory  (formulated  in  1990-1991)  to  the  case  of  moving  aerosols.  Unfortunately, 
work  in  this  area  has  not  progressed  as  we  had  hoped,  yet  future  plans  remain  to 
include  the  use  of  variable  wavelength  as  a  tool  in  particulate  diagnostics.  This 
program  of  research  has  been  heavily  leveraged  by  cost  participation  from  the 
University  of  Rochester,  the  industrial  sponsors  of  the  Center  for  Electronic  Imaging 
Systems,  the  New  York  State  Science  and  Technology  Foundation,  and  the  National 
Science  Foundation. 
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Section  2:  Technical  Progress  Report 


In  the  following  sections  we  present  descriptions  of  three  related  research  topics, 
starting  each  with  a  statement  of  the  problem  and  then  a  summary  of  important 
results. 

2.1  The  Random-walk  point  spread  function 

2.1 .1  Statement  of  the  Problem 

In  electronic  imaging  topics  of  major  interest  are  the  transmission  and  storage  of  high 
resolution  images.  Then,  in  cases  where  atmospheric  turbulence  leads  to  blurring, 
we  would  like  to  discover  image  recovery  methods  that  are  effective  in  restoring  high 
quality  images.  Additionally,  it  may  be  possible  to  blur  images  in  a  simple  controlled 
way  in  order  to  provide  security  or  better  image  compression  which  would  be  useful 
both  in  transmission  and  storage.  As  a  topic  of  basic  research,  we  believe  that  a 
study  of  controlled  blurring  caused  by  a  novel  point  spread  function  consisting  of  25 
to  250  randomly  distributed  delta  functions  will  lead  to  important  theoretical  results 
in  speckle,  in  function  theory,  and  in  image  recovery.  Moreover,  this  study  will  lead 
ultimately  to  better  methods  for  recovering  images  degraded  by  atmospheric 
turbulence.  One  research  objective  is  to  study  image  recovery  methods  using  the 
controlled  blurring  caused  by  a  random-walk  point  spread  function.  We  would  also 
like  to  study  other  blur  functions  particularly  in  regard  to  the  occurrence  of  zeros  in 
their  spatial  Fourier  transform.  Hopefully,  we  will  discover  several  important  new 
point  spread  functions  that  are  useful  for  controlled  blurring.  Related  objectives  are 
to  seek  to  establish  a  useful  quantitative  measure  of  image  quality  and  to  contribute 
to  an  understanding  of  better  methods  for  image  compression. 

2.1 .2  Summary  of  Results 

In  the  time  frame  of  this  report  Bryan  Stossel  completed  his  thesis  titled  “Image 
Processing,  Coding,  and  Compression  with  Multiple-Point  Impulse  Response  Func¬ 
tions"  and  received  his  Ph.D.  in  1 994.  The  multiple-point  impulse  response  is  unique 
among  degradations  in  imaging  systems.  Most  other  degradations  have  transfer 
functions  that  can  become  very  small  or  go  to  zero  at  many  spatial  frequencies.  This 
results  In  errors  in  the  recovery  when  the  degraded  image  is  divided  by  this  transfer 
function.  The  randomness  of  the  multiple-point  impulse  response  gives  a  zero  in  the 
transfer  function  once  in  only  1000  realizations.  Thus  the  reconstructions  are 
virtually  error-free.  An  added  benefit  is  that  this  makes  the  multiple-point  impulse 
response  an  ideal  tool  for  image  coding  and  compression  since  the  blurred  image 
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contains  much  less  high  frequency  detail  than  the  original  image  and  therefore  can 
be  compressed  to  much  higher  ratios  than  the  original  without  loss  of  information. 
And  unless  the  exact  point  spread  function  is  known,  reconstructing  the  original 
image  is  virtually  impossible  resulting  in  highly  secure  data  encryption.  A  patent  and 
several  publications  have  resulted  from  this  work. 

2.2  Image  Recovery  and  Blur  Identification  in  the  Fresnel  Zone 

2.2.1  Statement  of  the  Problem 

Image  restoration  deals  with  the  estimation  of  the  sharp  image  from  a  recorded 
image  which  is  degraded  by  blurring  and  noise.  Most  restoration  methods  assume 
that  the  blur  is  known  a  priori.  In  some  practical  situations,  the  type  of  blur  may  be 
known,  e.g. ,  out-of-focus,  but  the  amount  of  blurring  may  be  unknown  and  may  need 
to  be  estimated  before  restoring.  We  propose  to  investigate  the  blur  identification 
problem  in  four  stages. 

Stage  1 :  As  a  topic  of  central  importance  in  imaging  science,  one  needs  to  establish 
theoretical  bounds  to  image  restoration  from  blurred  samples  taken  at  various  planes 
in  the  Fresnel  zone.  Our  approach  to  this  is  to  apply  modem  coherence  theory  to  the 
computer  science  methodologies  in  order  to  devise  optimal  recovery  methods  and 
to  establish  theoretical  limits.  An  image  quality  metric  will  be  employed  in  order  to 
measure  the  recovered  images.  In  this  phase  of  the  research,  we  are  fortunate  to 
have  the  participation  by  Professor  Emil  Wolf. 

Stage  2:  We  propose  a  neural  network  approach  to  the  identification  of  the  amount 
of  defocus  in  recorded  images.  This  approach  is  motivated  by  the  successful 
application  of  neural  networks  to  solving  pattern  recognition  problems. 

Stage  3:  Another  goal  is  to  perform  a  comparative  study  of  blur  identification 
methods.  Despite  the  attention  that  the  blur  identification  problem  has  recently 
received,  there  is  no  single  comparative  study  of  the  existing  blur  identification 
methods.  The  objective  of  the  proposed  study  is  to  compare  the  existing  blur 
identification  methods  by  evaluating  (i)  their  applicability  to  various  blur  types, 
(ii)  their  performance  in  the  presence  of  noise,  and  (iii)  their  computational  efficiency. 

Stage  4:  We  will  finally  investigate  the  identification  of  blurs  due  to  depth  of  field.  We 
propose  to  apply  sectioned  methods  based  on  the  local  Fourier  transform.  We  also 
propose  to  investigate  the  wavelet  transform  as  an  alternative  to  the  local  Fourier 
transform.  The  objective  of  this  study  is  to  segment  the  degraded  image  based  on 
the  amount  of  defocus  on  each  section,  and  utilize  this  information  in  image 
restoration. 
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2.2.2  Summary  of  Results 


A  theoretical  analysis  has  been  performed  for  image  retrieval  when  a  planar 
transparency  is  illuminated  by  spatially  incoherent  light  that  propagates  in  free  space 
and  is  then  recorded  on  a  CCD  array,  but  without  using  an  imaging  lens.  Based  on 
Maxwell’s  eguations  and  Fourier-optical,  linear-systems  theory,  equations  were 
derived  for  digital  processing  of  this  badly  blurred  image  in  order  to  recover  a 
reasonable  facsimile  of  the  original.  Rigorous  impulse  responses  and  their  corre¬ 
sponding  transfer  functions  were  derived  for  the  cases  of  general  amplitude 
illumination  and  for  incoherent  illumination.  With  exact  results  in  the  framework  of 
Maxwell’s  equations,  we  found  that  free-space  propagation  from  a  planar  aperture 
is  space-invariant  in  general.  One  main  theme  was  to  derive  a  rigorous  expression 
for  the  optical-transfer-function  of  free  space,  and  thereby  secondly  to  study  the 
feasibility  of  image  retrieval  using  a  lensless  recording  system  and  post  digital 
processing.  We  foundthe  interesting  resuitthatthis  intensity  based  transferfunction 
consists  principally  of  a  modified  Bessel  function  of  the  second  kind,  K^(v),  which  is 
well  known  not  to  have  any  zeros  for  finite  real  values  of  its  argument.  The 
significance  of  this  is  that  recovery  of  the  pictorial  image  is  likely  using  digital 
processing  means.  A  paper  on  this  subject  has  been  published. 

We  have  successfully  sorted  a  scene-independent  set  of  images  based  on  blur  level 
using  a  computer  for  automatic  assessment  of  image  quality.  The  research  was  then 
extended  to  use  a  neural  network.  The  network  was  trained  to  sort  the  images 
according  to  blur  level  and  a  high  correlation  was  achieved  with  a  human  visual 
assessment.  A  paper  was  presented  at  the  47th  Annual  IS&T  Conference  in  1994. 

2.3  Retrieval  of  Spatial  Distribution  and  Size  of  Particles 

2.3.1  Statement  of  the  Problem 

Particle  measurements  are  of  special  importance  in  the  study  of  combustion 
processes,  pollution  control,  biological  experiments  and  many  other  military  and 
industrial  applications.  Optical  techniques  based  on  diffraction  with  laser  illumina¬ 
tion  are  most  frequently  used  among  all  optical  and  non-optical  methods.  The  optical 
measurement  requires  an  inversion  process  to  reconstruct  information  of  particle 
samples,  such  as  size,  shape  and  spatial  distribution.  Different  methods,  including 
direct  iritegral  transforms,  matrix  inversions  and  iteration  algorithms,  have  been 
studied  in  past  decades  and  most  of  them  are  used  solely  for  particle  sizing.  As  early 
as  in  1955  Shifrin  developed  the  original  integral-transform  method  for  recovering 
the  size-distribution  function  from  the  optical  transform  intensity  of  a  spherical 
particle.  However,  little  success  was  obtained  in  early  applications  of  this  inversion 
method  mainly  due  to  the  existence  of  speckles  in  the  scattered  field.  The  invention 


of  the  ring-wedge  photodetector  in  1970  resolved  the  speckle  problem  and  has  been 
since  applied  widely  to  optical  particle-size  measurements.  Matrix-inversion  tech¬ 
niques  have  been  used  to  analyze  the  intensity  information  obtained  by  ring 
detectors.  The  main  weakness  of  matrix  inversion  is  its  susceptibility  to  noise,  so  it 
does  not  provide  reliable  particle-size  distributions  especially  when  the  number 
density  of  particles  is  low.  Our  recent  study  presents  an  improved  theory  for  the 
inversion  formula  and  interesting  new  experiments  of  the  resolution  in  size  vs.  the 
sampling  angle.  Compared  with  Shifrin’s  first  formula  the  current  formula  does  not 
contain  a  derivative  of  the  measured  intensity  and  is  less  susceptible  to  noise. 
Experiments  using  the  ring-wedge  detector  and  this  inversion  formula  to  recover 
different  particle-size  distributions  show  excellent  agreement  with  the  theory. 

We  propose  to  extend  our  study  of  the  remote  sensing  of  particulates,  as  follows. 
Besides  size  distribution,  the  remote  sensing  will  include  recovering  information 
about  spatial  location,  speed,  and  number-density  distributions  of  the  scattering 
particles. 


2.3.2  Summary  of  Results 

For  the  third  topic,  we  had  intended  to  continue  with  the  remote  sensing  of 
particulates  to  include  extension  of  the  inversion  theory  (formulated  in  1990-1991) 
to  the  case  of  moving  aerosols.  Unfortunately,  work  in  this  area  has  not  progressed 
as  we  had  hoped,  yet  future  plans  remain  to  include  the  use  of  variable  wavelength 
as  a  tool  in  particulate  diagnostics. 
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Section  3:  Patents  and  Publications 


Patents 

"Image  data  coding  and  compression  system  utilizing  controlled  blurring," 
Nicholas  George  and  Bryan  J.  Stossel,  U.S.  Patent  No.  5,453,844,  September 
1995. 


Publications* 

‘The  blurred  bird,”  Nicholas  George  and  Bryan  J.  Stossel,  Technical  Note,  1 993. 

“Automatic  image  quality  assessment,”  David  M.  Berfangerand  Nicholas  George, 
IS&T’s  47th  Annual  Conference/ICPS  1994,  436-438  (1994). 

“Controlled  blurring  in  image  processing,”  Bryan  J.  Stossel  and  Nicholas  George, 
IS&T’s  47th  Annual  Conference/ICPS  1994,  534-535  (1994). 

“Object  recognition  and  image  coding,”  Nicholas  George,  B.  J.  Stossel,  and  D. 
M.  Berfanger,  invited  paper  presented  at  Takayanagi  Memorial  Session,  Asia 
Display  ‘95,  Hamamatsu,  Japan,  October  1995. 

“Multiple  point  impulse  responses:  controlled  blurring  and  recovery,”  Bryan  J. 
Stossel  and  Nicholas  George,  Opt.  Comm.  121, 156-165  (1995).  Erratum,  Opt. 
Comm.  122,  212(1996). 

“Lenless  electronic  imaging,”  Nicholas  George,  Opt.  Comm.  133, 22-26  (1997). 

“Effective  transmission  of  speckled  images  using  controlled  blurring,”  Nicholas 
George  and  Jun  Ren,  IEEE  Trans,  on  Ultrasound,  xxx,  pp  (1997),  in  review. 


‘Copies  of  journal  articles  can  be  found  in  the  Appendix. 
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Nicholas  George,  Principal  Investigator;  Director,  NSF-NYSSTF  S/IUCRC  Center 
for  Electronic  Imaging  Systems;  Director,  ARO-URI  Center  for  Opto-Elec- 
tronic  Systems  Research;  Wilson  Professor  of  Electronic  Imaging;  Professor 
of  Optics;  and  Professor  of  Electrical  Engineering 

Shen-Ge  Wang,  Scientist  in  Optics 

Dr.  Wang  received  his  Ph.D.  in  1986.  Thesis  title:  “Optical  transforms  in  white 
light." 

(Dr.  Wang  is  now  a  scientist  at  Xerox  Corporation,  Webster,  NY) 

Donald  J.  Schertler,  Scientist  in  Optics,  Center  for  Electronic  Imaging  Systems 
Dr.  Schertler  received  his  Ph.D.  In  1993.  Thesis  title:  “Wavelength  and 
roughness  dependence  of  backscattering” 

Bryan  J.  Stossel,  Scientist  in  Optics 

Dr.  Stossel  received  his  Ph.D.  in  1994.  Thesis  title:  “Image  processing, 
coding,  and  compression  with  multiple-point  impulse  response  functions." 

(Dr.  Stossel  is  now  a  scientist  at  Eastman  Kodak  Company,  Research 
Laboratories,  Rochester,  NY) 

Stojan  Radio,  Scientist  in  Optics 

Dr.  Radic  received  his  Ph.D.  in  1995.  Thesis  title:  “Periodic  structures  in 
multiwavelength  optical  systems." 

(Dr.  Radic  is  now  a  scientist  at  Corning,  Inc.,  Corning,  NY) 
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recognition  using  an  all  digital  ring-wedge  detector.” 

William  Wade  Cook,  Ph.D.  Fellow. 

Anticipated  date  of  Ph.D.  is  August  2000.  Thesis  topic:  holographic 
contouring  of  large  objects 
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Anticipated  date  of  Ph.D.  is  May  2001.  Thesis  topic:  holographic  optical 
switch 
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microscopy” 

Gregory  S.  Kaufman,  Technical  Computer  Assistant 


Wendell  Allen  Neff,  Ph.D.  Fellow 

Anticipated  date  of  Ph.D.  is _ .  Thesis  topic: 


Appendix  —  Publications 


UNIVERSITY  OF 


COLLEGE  OF  ENGINEERING  AND  APPLIED  SCIENCE 


ROCHESTER 


THE  INSTITUTE  OF  OPTICS 


The  Blurred  Bird 

Nicholas  George  and  Bryan  J.  Stossel 
Center  for  Electronic  Imaging  Systems 
The  University  of  Rochester 

29  October  1993 

In  a  long-term  study  of  image  recovery  for  atmospherically  degraded  images,  Nicholas 
George  and  Bryan  Stossel  have  been  investigating  an  idealized  multiple-point  impulse 
response.  For  theoretical  purposes  they  assert  a  multiple-point  impulse  response, 
similar  to  speckle  stellar  interferometry  in  which  a  single  impulse  is  imaged  as,  say,  25 
to  200  randomly  spaced  delta  functions.  Pictorially  the  effect  is  as  shown  In  the 
accompanying  photographs  with  the  blurred  object  as  shown.  It  appears  visually  as 
though  shrouded  in  fog,  certainly  it  is  blurred  far  beyond  recognition.  In  theoretical 
terms  it  is  readily  shown  that  the  spatial  frequencies  In  the  blurred  image  have  been 
reshaped  with  the  high  frequency  content  being  greatly  reduced  by  the  ratio  1/N,  where 
N  is  the  number  of  points  in  the  random-walk  impulse  response. 

An  almost  perfect  image  recovery  is  possible  using  an  Inverse  filter  generated  by  taking 
the  two-dimensional  spatial  Fourier  transform  (FFT)  of  the  degrading  impulse  response. 
Division  of  the  FFT  of  the  blurred  object's  intensity  leads  to  an  almost  perfect  recovery. 
It  is  surprising  that  a  simple  inverse  filter  is  so  effective,  since  in  many  other  image 
recovery  situations,  contours  of  zeros  in  the  Fourier  transform  leads  to  indeterminancies 
in  the  calculation  of  the  recovered  image.  For  the  random-walk  blur,  these  researchers 
have  shown  that  the  FFT  has  only  discrete  zeros  with  a  computational  chance  of 


University  of  Rochester 
Rochester,  New  \brk  14627 


running  into  a  zero  thereby  greatly  reduced.  They  estimate  some  trouble  with  the  image 
recovery  once  in  ten  thousand  frames. 

Two  interesting  commercial  applications  of  this  research  are  being  pursued.  Since  the 
high  frequency  detail  is  no  longer  apparent  In  the  blurred  image,  it  is  reasonable  to 
conjecture  that  FAX  transmission  of  the  images  would  require  less  space-bandwidth 
product  than  before.  Using  commercially  available  discrete-cosine-transform  routines, 
these  researchers  have  found  that  it  is  much  easier  to  transmit  the  blurred  bird  than  the 
original.  Estimates  for  improved  transmission,  reduced  pixels,  are  from  two  to  four 
times. 

Secondly,  transmission  of  the  blurred  object  gives  the  sender  a  degree  of  privacy.  With 
the  widespread  increase  of  FAX  for  color  photographs,  it  is  becoming  increasingit 
important  to  provide  some  degree  of  privacy  in  transmission,  particularly  for  commercial 
art  in  advertising  displays.  Related  experiments  are  presently  being  conducted  for  the 
coding  and  transmission  of  engineering  drawings  and  topographic  maps. 

This  research  is  being  supported  by  the  Directorate  of  Physics  of  the  U.  S.  Army 
Research  Office. 
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Automatic  Image  Quality 
Assessmentt 
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Introduction 

Psychovisual  methods  of  image  quality 
assessment,  such  as  those  described  by  Roufs, 
have  a  high  correlation  between  observers  and 
are  widely  considered  the  standard  by  which 
all  other  measures  of  image  quality  are 
compared.^  The  development  of  automated 
methods  of  image  quality  assessment  have 
reflected  this.  Grogan  and  Keene  have 
developed  a  method  of  image  quality 
measurement  based  on  a  computational  model 
for  the  human  perception  of  image 
brightness.^  Nill  and  Bouzas  have  presented 
an  image  quality  measure  based  on  the  digital 
image  power  spectrum,  which  includes  a 
model  for  the  modulation  transfer  function  of 
the  human  visual  system.^  Saghri,  Cheatham, 
and  Habibi  have  presented  a  preliminary 
image  quality  measure  which  takes  into 
account  both  the  illumination  level  sensitivity 
and  the  spatial  frequency  sensitivity  of  the 
human  visual  system.^  Davies,  Rose,  and 
Smith  have  described  an  automatic  image 
quality  meter  incorporating  a  model  of  the 


human  visual  system  derived  from  both 
psychophysical  and  neurophysiological 
studies.^ 

In  our  research  a  principal  concern  is  to 
establish  limits  on  automatic,  operator- 
independent,  image  quality  assessment  with 
the  goal  of  determining  whether  computerized 
systems  can  perform  at  the  level  of  a  human 
observer  when  assessing  images  widely 
vaiying  in  scene  content.  In  this  report  we  are 
considering  the  possibility  of  using  diffraction 
pattern  sampling  in  combination  with  neural 
network  software  in  the  assessment  of  image 
quality.  Our  approach  will  be  to  present  two 
preliminary,  illustrative  experiments.  The 
first  experiment  uses  a  simple  data  base 
obtained  from  professional  stock  photography 
and  degraded  using  various  levels  of 
computer-generated  blurring.  We  study  this 
sorting  task  for  academic  purposes.  The 
second  experiment  involves  a  limited  data 
base  obtained  from  the  Eastman  Kodak 
company  that  was  created  using  various  lossy- 
compression  and  retrieval  techniques  and  was 
accompanied  by  visual  quality  ratings  made 
by  trained  photointerpreters.  Preliminary 
results  for  both  experiments  are  promising. 


t  Research  supported  in  part  by  the  National  Science  Foundation ,  the  NYS  Science  and  Technology 
Foundation  and  the  Army  Research  Office. 
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Diffraction  Pattern  Sampling  and 
Neural  Network  Software 

Diffraction  pattern  sampling  is  an  optical 
technique  of  spectral  analysis  based  on  the 
properties  of  the  Fourier  spectrum  of  a  real 
image.  Earlier  experiments  have  been 
described  in  which  diffraction  pattern 
sampling  has  been  used  successfully  to 
implement  image  quality  metric 
algorithms  and  diffraction  pattern 

sampling  in  connection  with  neural  network 
software  has  also  been  used  successfully  to 
classify  finger  prints,  faces,  and  particulate 
suspensions,  as  well  as  to  distinguish 
differences  between  dogs  and  cats.  The 
optical  portion  of  the  diffraction  pattern 
sampling  system  is  shown  in  Pig.  1.  Coherent 
illumination  is  provided  by  a  laser  beam  that 
is  expanded  and  collimated  by  a  spatial  filter 
and  a  collimating  lens.  A  neutral  density  filter 
is  used  to  control  the  intensity.  The  object 
plane  is  adjacent  to  an  optical  transform  lens. 
A  ring-wedge  detector  is  centered  in  the  back 
focal  plane  of  the  transform  lens.  ®  The  output 
signals  from  this  detector  are  amplified, 
digitized,  and  sent  to  a  digital  computer  for 
further  processing. 

For  the  experiments  in  this  paper, 
diffraction  pattern  sampling  is  digitally 


Ofa[iect 

Figure  J.  Block  diagram  of  the  optical  portion  of  the 
diffraction  pattern  sampling  systenu 


simulated  using  a  standard  FFT  algorithm, 
and  the  resulting  ring-wedge  data  is  provided 
to  neural  network  software  for  quality  sorting 
tasks.  This  simulation  is  to  be  described  more 
fully  in  a  separate  publication.  The  use  of 
neural  network  software  allows  the  study  of 
differing  network  structures  both  before  and 
after  training;  furthermore,  in  choosing 
appropriate  data  sets  and  in  pre-selecting 
what  information  is  given  to  the  network,  we 
believe  it  possible  to  obtain  a  better 
understanding  of  what  measurable  aspects  of 
an  image  contribute  to  its  perceived  quality. 

Sorting  Blur  Level 

As  a  first  step  in  our  research,  a 
preliminaiy  experiment  was  conducted  for  the 
specific  task  of  sorting  images  of  differing 
scene  type  based  on  blur  level  within  the 
images.  We  have  chosen  to  study  this  sorting 
task  for  academic  purposes. 

Ten  digitized,  high-quality  images  were 
obtained  from  professional  stock  photography. 
These  images  represented  five  different  scene 
types:  birds,  text,  human  faces,  buildings,  and 
landscapes.  Four  degrees  of  degradation  for 
each  of  these  images  were  then  created  by 
introducing  increasing  amounts  of  computer¬ 
generated  Gaussian  blur.  This  produced  a 
data  set  of  fifty  pictures  at  five  distinct  blur 
levels,  which  are  described  by  the  adjectives 
"veiy  good,"  "good,"  "fair,"  "poor,"  and  "very 
poor." 

The  digitally  simulated  ring-wedge  data 
for  each  of  the  images  in  the  data  set  were 
subdivided  into  training  and  testing  sets.  A 
standard  feed-forward  neural  network  trained 
using  the  back  propagation  paradigm  was 
chosen.  This  network  had  32  ring-data  input 
neurons,  32  wedge-data  input  neurons,  20 
hidden  neurons,  and  5  output  neurons 
corresponding  to  the  five  blur  levels.  The 
network  was  trained  and  tested.  Tables  1(a)- 
2(b)  show  the  recognition  results  from  two 
different  training-testing  strategies.  The  first 
strategy,  detailed  in  Table  la,  includes  a 
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Image  Type 

Learning 

Test 

Biid 

A 

B 

IEEE  Chart 

A 

B 

Face 

A 

B 

Building 

A 

B 

Landscape 

A 

B 

(a) 


Blur  Level 

errors 

recognition 

very  good 

0 

100% 

good 

0 

100% 

fair 

1 

80% 

poor 

1 

80% 

very  poor 

1 

80% 

(b) 


Table  L  (a)  Training -testing  strategy  for  an 
experiment  based  on  blur-level  recognition.  Each 
letter  symbol  represents  an  original  and  the  four 
corresponding  degraded  versions  of  that  original, 
(b)  Hecognition  results  detailing  error  occurrences 
and  correct  recognition  percentage 


Image  Type 

Learning 

Test 

Bird 

A 

B 

IEEE  Chart 

A 

B 

Face 

A.B 

Building 

A 

B 

Landsci^ 

A,B 

(a) 


Biur  Levei 

errors 

recognition 

very  good 

0 

100% 

good 

0 

100% 

fair 

1 

86% 

poor 

2 

71% 

very  poor 

1 

86% 

(b) 


Table  2.  (a)  Training-testing  strategy  for  an 
experiment  based  on  blur-level  recognition.  Each 
letter  symbol  represents  an  original  and  the  four 
corresponding  degraded  versions  of  that  original, 
(b)  Recognition  results  detailing  error  occurrences 
and  correct  recognition  percentage. 


representative  from  each  scene  type  in  both 
the  learning  and  the  testing  sets.  After 
training  with  this  strategy,  the  neural 
network  was  able  to  recognize  the  blur  level  of 
the  images  in  the  testing  set  with  the 
exception  of  three  errors.  The  occurrence  of 
these  errors  and  the  percentage  of  correct 
assessments  for  each  blur  level  are  presented 
in  Table  lb.  The  second  strategy,  detailed  in 
Table  2a,  includes  only  three  of  the  five  scene 
types  in  the  learning  set  and  all  five  types  in 
the  testing  set.  After  training  with  this 
strategy,  the  neural  network  was  able  to 
recognize  the  blur  level  of  the  images  in  the 
testing  set  with  the  exception  of  four  errors. 
The  occurrence  of  these  errors  and  the 
percentage  of  correct  assessments  for  each 


blur  level  are  presented  in  Table  2b. 

Sorting  Degradation  Produced  by  Lossy 
Compression 

As  another  aspect  of  our  research,  we  wish 
to  examine  the  effects  of  lossy  image 
compression  on  the  perceived  quality  of 
images.  A  preliminary  experiment  was 
conducted  using  a  data  set  provided  by  the 
Eastman  Kodak  Company  based  on  retrieval 
of  images  from  several  different  compression 
routines  and  accompanied  by  a  visual  quality 
ratings  made  by  trained  photointerpreters. 

As  in  the  previous  experiment,  the 
digitally  simulated  ring-wedge  data  for  each  of 
the  images  in  the  data  set  were  subdivided 
into  training  and  testing  sets,  and  a  standard 
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feed-forward  neural  network  trained  using  the 
back-propagation  paradigm  was  again  chosen. 
This  network  had  32  ring-data  input  neurons, 
32  wedge-data  input  neurons,  20  hidden 
neurons,  and  6  output  neurons  corresponding 
to  6  equidistant  points  on  the  scale  used  for 
the  visual  ratings  of  the  images,  which  ranged 
for  zero  to  five.  The  network  was  trained  and 
tested.  The  results  from  the  testing  set  showed 
a  correlation  between  the  automatic 
assessments  and  the  human  assessments  of 
0.92. 

Summary 

The  preliminary  experiments  presented  in 
this  report  show  encouraging  results.  Using 
digitally  simulated  diffraction  pattern 
sampling  in  combination  with  neural  network 
software,  we  have  been  able  to  rate  images 
based  on  the  amount  of  blur  added  to  the 
image  and  the  amount  of  degradation 
produced  by  lossy  compression  routines.  As  a 
result,  each  of  these  experiments  is  currently 
being  re  performed  using  larger  data  bases 
containing  five  hundred  or  more  images.  It  is 
our  hope  that  these  and  other  experiments 
will  show  that  for  certain  tasks  automated 
image  quality  assessment  will  be  capable  of 
performing  at  the  level  of  human  assessment. 
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Processing 
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Introduction 

This  paper  reports  some  of  the  results  of  our 
research  conducted  in  image  processing  with 
multiple-point  impulse  responses.  The  multiple 
point  impulse  response  (MPIR)  is  defined  as  a 
number  of  impulses  positioned  within  a 
prescribed  region.!^!  The  results  of  this  work 
have  applications  for  imaging  through 
turbulence,  where  this  point-spread-function 
represents  an  idealized  model  of  the 
atmosphere,  and  also  image  coding  and 
transmission.  This  research  provides 
information  about  the  limits  of  real-time 
adaptive  imaging  imposed  by  the 
atmosphere.[2»3] 

We  will  discuss  the  effects  of  blurring  an 
intensity  object  scene  with  an  MPIR  and  also 
show  reconstructions  obtained  using  an 
appropriate  inverse  filter.  Also  considered  are 
some  applications  of  this  research  to  image 
coding  and  transmission. 


Blurring  and  reconstructions 

The  effect  of  the  MPIR  is  to  image  a  single 
impulse  as,  say,  25  to  200  irregularly  positioned 
delta  functions.  A  representative  psf  is  shown 
in  Fig.  1  where  25  points  are  placed  within  a 
64x64  pixel  window  centered  on  the  origin.  This 
image  has  been  enlar^d  by  a  factor  of  2  in  order 
to  show  clearly  the  impulses.  Pictorially  the 
effect  of  the  MPIR  on  an  object  scene  is  as 
shown  in  Fig.  2.  The  blurred  image  is  produced 
by  convolution  of  the  MPIR  with  an  original 
scene  consisting  of  256x256  pixels  with  8 
bits/pixel.  The  resulting  image  is  then 
quantized  to  8  bits/pixel.  seen  in  Fig.  2,  it 
appears  visually  as  though  the  original  scene  is 
shrouded  in  fog,  certainly  it  is  blurred  far 
beyond  recognition.  In  theoretical  terms  it  is 
readily  shown  that  the  power  spectrum  in  the 
blurred  image  have  been  reshaped  with  the  high 
frequency  content  being  greatly  reduced  by  the 
ratio  1/N,  where  N  is  the  number  of  points  in 
the  MPIR. 


An  almost  perfect  image  recovery  is  possible 
using  an  inverse  filter  generated  from  the  two- 
dimensional  spatial  Fourier  transform  (FFT)  of 
the  d^ni^ding  impulse  response.  Division  of  the 
FFT  of  the  blurred  object's  intensity  by  the 
transfer  function  leads  to  an  almost  perfect 
recovery.  It  is  surprising  that  a  simple  inverse 
filter  is  so  effective,  since  in  many  other  image 
recovery  situations,  contours  of  zeros  in  the 
transfer  function  lead  to  indeterminancies  in  the 
calculation  of  the  recovered  image.  For  the 
random-walk  blur,  we  have  shown  that  in 
general  the  FFT  has  only  discrete  zeros  with  the 
computational  chance  of  encountering  a  zero 
thereby  greatly  reduced. 

We  will  also  discuss  the  artifacts  introduced 
by  several  sources  of  error,  using  the  artifact 
classification  method  of  Tekalp  and  Sezan.l^l 
Included  in  the  discussion  are  the  effects  of 
having  incorrect  magnitudes  for  the  impulses  in 
the  psf  used  in  the  inverse  filter  as  well  as 
incorrectly  positioning  the  impulses. 


Applications 

Two  interesting  commercial  applications  of 
this  research  are  being  pursued.  Since  the  high 
frequency  detail  is  no  longer  apparent  in  the 
blurred  image,  it  is  reasonable  to  conjecture  that 
FAX  transmission  of  the  images  would  require 
less  space-bandwidth  product  than  before. 
Using  commercially  available  discrete-cosine- 
transform  routines,  we  have  found  that  it  is 
much  easier  to  transmit  the  blurred  bird  than 
the  original.  Estimates  for  improved 
transmission,  reduced  pixels,  are  from  two  to 
four  times. 

Secondly,  transmission  of  the  blurred  object 
gives  the  sender  a  degree  of  privacy.  With  the 
widespread  increase  of  FAX  for  color 
photographs,  it  is  becoming  increasing 
important  to  provide  some  degree  of  privacy  in 
transmission,  particularly  for  commercial  art  in 
advertising  displays.  Related  experiments  are 
presently  being  conducted  for  the  coding  and 


transmission  of  engineering  drawings  and 
topographic  maps. 
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Figure  1  MPIR  consisting  of  25  points,  irregularly 
positioned  within  a  64x64  pixel  window.  The  image 
has  been  enlarged  by  a  factor  of  2  for  viewing 
purposes. 


Figure  2  Blurred  image  using  the  25-point  impulse 
response  furwtion  corresponding  to  Fig.  I. 


corresponding  the  psf  of  Fig.  1.  This  image  contains 
256x256  pixels  and  is  an  excellent  representation  of 
the  original  scene. 
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INTRODUCTION 

Research  in  electronic  imaging  is  being 
conducted  in  a  newly  formed  consortium  in  the 
Rochester  communitj".  The  Universitj'  of 
Rochester  and  the  Rochester  Institute  of 
Technology  have  joined  with  leading  corporations 
including  Xerox,  Eastman  Kodak,  3M,  Harris/RF 
Connnunications,  and  others  in  order  to  conduct 
cooperative  research  in  electronic  imaging.  We 
have  grouped  the  separate  research  into  9  major 
themes.  In  this  presentation  we  will  briefly 
review  the  scope  of  this  Centers  activity.  Then, 
we  wdll  illustrate  recent  research  results  in  tv'o 
of  the  themes  in  more  detail. 

For  object  recognition,  we  describe  an  all- 
digital  system  that  replaces  the  analog  ring- 
wedge  detector.^  Other  investigators  have 
considered  various  hybrids:  laser  illumination 
with  a  CCD  array  in  the  transform  plane  and  a 
software  RW  detector;*  laser  illumination  and  a 
holographic  element  to  obtain  RW-data  format;^ 
incoherent-to-coherent  liquid  crystal  interface, 
laser  illumination,  holographic  optical  element  to 
obtain  RW-format;^  and  a  RW-detector,  laser 
illumination  wdth  a  neural  network  for  the 
classifier.’  With  respect  to  fingerprints  important 
approaches  are  described  in  the  literature.®  *“  A 
valuable  source  for  neural  network 
programming  is  the  text  ly’’  Masters. “  Our  main 
objective  in  this  paper  is  to  compare  the 
performance  of  an  all-digital  RW-detector  system 


incorporating  the  ring-wedge  photodetector  and  neural- 
network  software:  0,  input  object;  L,  optical-transform 
lens;  RAV,  ring-wedge  photodetector;  NS,  neural 
software;  C,  digital  computer;  A,  amplifier  and 
interface. 

Invilod  papor  pmsontwi  and  Takayanapi  Memorial  Session,  Asia 
Display  *i)5,  Hamamatsu,  Japan,  Octolier  ISWr). 


with  that  of  the  analog  multi-element  array.  To 
do  this,  we  repeat  and  extend  an  earlier 
experiment.’^ 

AUTOMATIC  OBJECT  RECOGNITION 
Fingerprint  Recognition 

In  the  literature  excellent  results  have 
been  reported  for  automatic  recognition  of 
thumbprints  using  the  basic  dififaction-pattem 
samphng  setup  shown  in  Fig.  1.  From  Ref  12,  we 
illustrate  the  data  set,  8  thumbprints  labeled  Fl 
through  F8.  Using  the  an^og  ring-wedge 
detector  and  laser  illumination,  we  reported  an 
error  of  1  in  160,  see  Table  1.1.  In  the  present 
study  oxir  central  objective  is  to  establish  the 
accuracy  of  an  all-digital  configuration,  as  shown 
in  Pig.  2.  It  consists  of  an  object  (glass  slide  with 
thumbprint),  a  lens  imaging  to  a  CCD-aixay  in 
white  light,  followed  by  the  dl-digital  recognition 
module.  For  the  image  acquisition,  it  is  important 
to  recognize  that  fingerprints  are  rather 
complicated  images,  requiring  approximately 
4  X 10^  pixels  each  for  adequate  representation. 

All-Digital  Ring-Wedge  Detector 

For  pattern  recognition  of  an  input  image 
in  white  light,  we  would  like  to  assert  that  the  use 
of  a  ring-wedge  detector  array  in  the  Fourier 
space  of  the  intensity-based  array  image  is  a 
reasonable  approach.  With  the  intensity-based 
Fourier  transform,  we  will  demonstrate  that  both 
spatial  spectral  density  and  edge-content  and 
edge-angle  correlations  are  useful  data  forms  for 
object  recognition.  Since  the  original  RW-detector 
had  32  rings  and  32  wedges  based  upon 
automating  recognition  in  high  resolution 
images  in  film,’  we  will  use  this  as  a  basis  for  om* 
all-digital  RW-detector  array.  Hence,  in  Fig.  2,  We 
have  incorporated  software  appropriate  for  a 


Fig.  2.  All-digital  recognition  system  shown  in  dashed 
box,  including  software  embodiment  for  FFT,  ring- 
wedge  data  format,  and  neural  software. 


Fig.  3.  Thumbprints  used  in  thumbprint  sorting 
experiments:  FI  to  F8,  reading  from  left  to  right,  top  to 
bottom. 

2-dimensional  FFT  followed  by  a  software  RW- 
detector  module.  There  is  data  normalization 
followed  by  a  neural  network  to  perform  the 
recognition. 

In  the  experiment  described  in  Ref.  12,  the 
optical  Fourier  transforming  system  was  set  up 
such  that  the  outer  edge  of  the  ring-wedge 
detector  corresponded  to  a  spatial  frequency  of 
10.3  cycles/mm.  Therefore,  for  the  subsequent  all- 
digital  experiments  described  in  the  next  section, 
digital  images  of  all  thumbprints  in  the  data  set 
were  acquired  using  a  scanning  resolution  of 
20.6  samples/mm  (8  bits/sample),  corresponding 
to  a  Nyquist  frequency  of  10.3  cycles/mm.  The 
sampling  geometry  of  the  digital  system  was  then 
chosen  to  approximate  closely  the  geometry  of 
corresponding  elements  in  the  analog  detector 
array. 

Recognition  Experiments 

Table  1.2  details  the  results  of  a  sorting 
experiment  using  digital  ring-wedge  data 
calcvilated  directly  from  the  8-bit-per-pixel, 
thumbprint  images.  As  in  the  experiment 
described  in  Ref  12,  the  data  were  separated  into 
a  learning  set  (5  each)  and  a  testing  set  (20  each). 
In  structuring  the  neural  network  we  chose  a 
three-layer,  fully  connected,  feedforward 
configuration  trained  using  a  normalized 
cumulative  backpropagation  learning  paradigm. 
The  network  ^d  59  input  neurons  (rings  6-32 
and  wedges  1-32),  12  Udden  neurons,  and  8 
output  neurons  (F1*F8).  Input  dato  were 
preprocessed  to  be  scaled  approximately  from  -1 
to  +1.  The  logarit^s  of  the  ring  data  were  used 
with  an  appropriate  bias  subtracted  off  and 
wedge  data  were  rank  ordered  and  normalized. 
We  found  an  error  rate  of  2  in  160.  Separately,  we 
have  been  successful  with  ring-only  (orientation- 
independent)  and  wedge-only  (scale-independent) 
sortings. 


Table  1.1 

Maximuiri  Valued  Ouput  Neuron 

Testing  Set 

1  2 

3 

4 

5 

6 

7  8 

FI 

20 

F2 

20 

F3 

20 

F4 

20 

F5 

20 

F6 

1 

19 

F7 

20 

FS  ' 

20" 

Table  1.2 

Maximum  Valued  Ouput  Neuron 

Testing  Set 

1  2 

3 

4 

5 

6 

7  s’ 

FI 

20 

F2 

19 

1 

F3 

20 

F4 

20 

F5 

20 

F6 

19 

1 

F7 

FS 


20 


20 


Table  1.3 
Testing  Set 


Maximum  Valued  CXapuL  Neuron 


1 


3 


4 


6 


8 


FI 

F2 

F3 

F4 

F5 

F6 

F7 

F8 


20 


20 


20 


20 


20 


20 


20 


20 


Table  1.4 

Maximum  V'alued  Ouput  Neuron 

Testing  Set 

1  2  3  4  5  6  7  8 

FI 

20 

F2 

20 

F3 

20 

F4 

20 

F5 

20 

F6 

20 

F7 

20 

FS 

20 

Table  1.3  details  the  results  from  a  sorting 

experiment  using  digital  ring-wedge  data 
calculated  from  binary  images  of  the  fingerprints 
obtained  by  globally  thresholding  each  image  at 
its  mean  gray  level  value,  i^en  the  same 
leaming/testing  strategy,  network  structure,  and 
input  preprocessing  were  utilized,  as  described 
above,  we  found  zero  errors  in  160. 

Table  1.4  details  the  results  from  a  sorting 
experiment  using  digital  ring-wedge  data 
calculated  from  only  the  odd  part  of  the  binary 
images  used  previously.  The  saiAe 
leaming/testing  strategy,  network  structure,  and 
input  preprocessing  were  utilized,  as  described 
above.  Again,  we  found  zero  errors  in  160.  A 
similar  experiment  using  only  the  even  part  of 
the  binary  images  also  resulted  with  zero  errors 
in  160.  The  use  of  even-part,  odd-part,  and  phase 
features  of  the  all-digital  system  presents 
important  new  possibilities  which  we  are 
investigating. 


L  BIAGE  BLUR  FOR  CODING 

Image  Restoration  and  the  MPIR 

Image  restoration  for  scenes  that  have  been 
degraded  by  a  multiple-point  impulse  response 
,(MPIRi  has  been  studied  recently*®"’^.  The 

ultiple-point  impulse  response  is  prescribed  to 
ue  a  number  of  impulses  positioned  within  a 
specified  region.  The  MPIR  provides  a 
particularly  interesting  case  of  blurring  that  lends 
itself  to  theoretical  calculations  such  as  the 
filtering  properties  of  the  transfer  function  and 
,the  average  number  of  zeros  per  area  of  the 
transfer  function.  This  impulse  response  also  has 
interesting  applications  for  image  coding  and 
compression 

Our  central  interest  is  the  recovery  of  intensity 
images  that  have  been  blurred  by  a  multiple-point 
impulse  response,  b(x,y)  that  consists  of  a  number, 
N,  of  irregularly  positioned  impulses  defined  by 

.V 

h[x. y)  =  '£  Six  -  X, ,y-y,X  ( 1.) 

rf=l 

where  5Cx,y)  is  the  two-dimensional  Dirac  delta 
function  and  are  the  positions  of  the 

impulses  as  in  Fig.  4.  The  transfer  function 
corresponding  to  this  multiple-point  blur  function 
is 

.V 

B{u. u)  =  ^ exp[-i2.T(u.\:„  vy, )] .  (2, 

n=i 

.nere  i-=-l.  One  notices  immediately  the  random- 
walk  nature  of  this  transfer  function. 

We  now  present  the  results  of  blurring  an 
original  scene  with  an  MPIR  of  the  form  given  by 
Eq.  (1)  as  well  as  reconstruction  results  using  a 
generalized  inverse-filter  algorithm.  The  MPIR, 
shown  in  Fig.  4,  consists  of  50  unit  amplitude 
impulses  uniformly  distributed  within  a  64x64 
pixel  region,  centered  on  the  origin.  The  original  8 
bits/pixel  object  scene  is  blurred  by  the  MPIR  and 
quantized  to  8  bits/pixel,  thus  introducing 
quantization  noise.  The  blurred  image  is  shown  in 
Pig.  5.  The  original  object  scene  has  been  zero- 

padded  to  ehminate  truncation  artifacts^®.  One 
can  see  from  this  figure  that  the  50-point  impulse 
response  has  obscured  the  fine  details  of  the 
-image  and  that  the  original  object  is  no  longer 
distinguishable.  The  recovered  image  shown  in 
Pig.  6  is  an  excellent  representation  of  the  original 
•object.  Similarly  good  reconstructions  are  obtained 
for  25  impulses  within  the  same  &fcc64  pixel 
window,  as  well  as  for  100  and  200  impulses. 

The  excellent  results  obtained  in  Fig.  6  are  due  to 
the  fact  that  the  zeros  of  the  random-walk  transfer 
'  notion  B(u,v)  occur  at  isolated  frequencies.  W’e 
ave  derived  a  theoretical  expression  for  the 
average  number  of  zeros  per  area  present  in  the 
transfer  fimction  based  on  previous  work  on  the 
zeros  of  speckle  pattems.^’^'*'^^ 


Fig.  4  A  typical  MPIR  consisting  of  50  impulses 
uniformly  distributed  within  a  64x64  pixel  window. 


Fig.  5  The  blurred  image  resulting  from  the  convolution 
of  the  impulse  response  of  Fig.  4  and  the  original  scene. 
The  original  scene  is  obscured  within  this  image. 


Fig.  6  The  restored  original  scene  using  a  generalized 
inverse  filter  algorithm.  Note  the  high  frequency  details 
of  the  rotunda  and  flag  pole. 

Filtering  properties  of  the  MPIR 
An  important  aspect  of  the  MPIR  and  the 
corresponding  random-walk  transfer  function  is 
its  filtering  properties.  A  convenient  measure  of 
the  frequency  response  of  the  S3rstem  is  the 
average  power  spectrum,  ^B(u,v)B'(u,v)j  where 
the  asterisk  represents  the  complex  conjugate  and 
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Fig.  7  Plot  of  the  average  power  spectrum  for  the  case 
where  50  impulses  are  uniformly  distributed  within  a 
64x64  window. 


the  ensemble  average  is  over  an  ensemble  of 
different  realizations  of  Xn  and  jn-  Substitution  of 
Eq.  (2)  into  the  average  power  spectrum  yields 

{B(u,u)B*(u.u))  =  (Xexp[-i2;r(ux'^  + 

\mal 

N  \ 

xX  exp[i2;r(ux„  +  vy„ )] }.  (4) 

ri=l  / 

Omitting  the  details  of  the  statistical 
calculation^^  we  can  evaluate  Eq.  (4)  based  on  the 
assumptions  that  Xn  and  y„  are  independent, 
uniformly  distributed  random  processes  within  a 
window  WVWy-  The  resulting  expected  value  for 
the  pow'er  spectrum  is  foimd  to  be 

+{JV^  -  N)  sine  ^  )  sine  ^  (u  Wy ) .  ( 5 ) 

From  Eq.  (5)  it  can  be  seen  that  the  high  spatial 
frequencies  are  attenuated  by  a  factor  of  UN  with 
respect  to  the  dc  value.  These  characteristics  can 
be  seen  in  Fig.  7  which  contains  a  plot  of  the 
average  power  spectrum  w’hen  Wjc=W’j.=64. 
Shown  in  the  plot  are  three  ounces:  the  theoretical 
curve  corresponding  to  Eq.  (5),  an  experimental 
curve  for  an  ensemble  of  50  members,  and  an 
experimental  curve  for  a  single  realization. 


Image  compression  and  noise 

The  controlled  image  blur,  as  in  Fig.  5,  is  well 
suited  to  efficient  and  private  data  transmission 
and  we  describe  the  use  of  DPCM  and  DCT-based 
algorithms.  For  DPCM  compression,  we  find  that 
the  bit  rates  required  in  a  Huffinan  code  can  be 
reduced  up  to  50%  by  using  a  multiple-point  blur 
prefilter.  Correspondingly  we  find  a  reduction  of 
70%  in  the  bit  rate  for  the  DCT-based  case,  over 
using  DCT  with  the  original  image.  It  is  foxmd 
that  practical  bit  rates  on  the  order  of  one  bit  per 
pixel  can  be  achieved  with  excellent  quality.  We 
find,  too,  that  controlled  blurring  is  useful  in 


transmitting  images  ffiat  are  immersed  -in 
speckle,  using  the  simple  test  target  shown  in  Fig. 
S’®.  Controlled  blurring  provides  a  useful  means 
of  coding  a  speckled  image  for  efficient 
transmission  and  recovery.  This  technique  is 
expected  to  be  of  value  in  the  transmission  of 
ultrasound  images.  This  research  w'as  supported 
in  part  by  the  U.S.  Army  Research  Office  and  by 
tlie  National  Science  Foundation. 


■  m 


algorithms  on  images  corrupted  by  speckle  noise’.  Lower: 
Typical  speckle  noise  where  tlie  average  speckle  size  is 
on  the  order  of  the  smallest  test  target  object. 
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Due  to  an  oversight  of  the  publisher  two  figures  on  p.  158  of  the  paper  are  interchanged.  The  correct  figures 
with  their  captions  are  as  follows: 


Fig.  1.  MPIR  consisting  of  25  points,  intgulariy  positioned  within 
a  64  X  64  pixel  window.  The  image  has  been  enlarged  and  the 
grey  levels  inverted  (black  &  255)  to  show  detail. 


Fig.  2.  Blurted  image  using  the  25-point  impulse  response  function 
shown  in  Fig.  1.  The  original  scene  contains  256  x  256  pixels. 


0030-4018/96/$12.00  ©  1996  Elsevier  Science  B.V.  All  rights  reserved 
550/0030-4018(95)00705-9 


1  December  1995 


'm 


ELSEVIER 


Optics  Communications  121  (1995)  156-165 


Optics 

Communications 


Full  length  article 

Multiple-point  impulse  responses: 
controlled  blurring  and  recovery 

Bryan  J.  Stossel,  Nicholas  George 

The  institute  of  Optics,  University  of  Rochester,  Rochester,  NY  14627,  USA 
Received  12  April  1995;  revised  version  received  10  July  1995 


Abstract 

We  present  the  results  of  controlled  blurring  of  an  image  using  a  multiple-point  impulse  response  and  thereafter  recovering 
the  original  scene  using  a  generalized  inverse  filter.  The  multiple-point  impulse  response  consists  of  delta-function  impulses 
irregularly  positioned  within  a  prescribed  area.  This  impulse  response  is  shown  to  degrade  the  image  beyond  recognition. 
Excellent  recoveries  are  obtained  for  pictorial  and  textural  images.  An  important  result  is  that  the  zeros  of  the  transfer  function 
occur  at  discrete  locations  and  therefore  have  a  negligible  effect  on  the  image  recovery  using  the  generalized  inverse  filter. 


!•  Introduction 

Several  aspects  of  image  restoration  for  scenes  that 
have  been  degraded  by  a  multiple-point  impulse 
response  (MPIR)  are  presented.  The  multiple-point 
impulse  response  is  prescribed  to  be  a  number  of 
impulses  positioned  within  a  specified  region.  This 
impulse  response  provides  a  particularly  interesting 
case  of  blurring  that  lends  itself  to  theoretical  calcula¬ 
tions,  and  hence  leads  to  a  better  understanding  of  the 
limits  imposed  on  image  recovery.  In  this  paper  our 
interest  is  the  use  of  the  MPIR  to  blur  an  object  scene 
in  a  controlled  manner.  Such  an  application  reduces  the 
amount  of  high  frequency  detail  in  the  image  and  can 
render  the  original  scene  unrecognizable  to  an  observer. 
We  believe  that  study  of  this  highly  idealized  impulse 
response  may  have  importance  in  image  compression 
and  may  provide  insight  into  image  recovery  for  images 
degraded  by  propagation  through  a  turbulent  medium. 

*  This  research  is  supported  in  part  by  the  U.S.  Army  Research 
Office,  the  National  Science  Foundation,  and  the  New  York  Slate 
Science  and  Technology  Foundation. 


Early  image  restoration  using  inverse  filtering  and 
computer  methods  are  described  by  Harris  [1].  The 
extension  to  optical  processing  in  the  presence  of  noise 
[2]  and  a  comprehensive  listing  of  various  image  res¬ 
toration  methodologies  [3]  have  been  published.  In 
this  early  work  attention  was  directed  toward  the  del¬ 
eterious  effects  of  contours  of  zeros  in  the  blur  transfer 
function.  These  zero  contours  inhibit  the  use  of  the 
inverse  filter  in  most  practical  applications.  A  signifi¬ 
cant  result  presented  here  is  that  essentially  complete 
image  recovery  is  possible  for  blurring  due  to  MPIR 
degradations  using  a  generalized  inverse  filter.  As 
described  herein,  the  excellent  reconstructions  are  pos¬ 
sible,  in  large  part,  because  the  zeros  of  the  transfer 
function  occur  at  discrete  locations  and  thus  are  rarely 
encountered  in  sampling  with  the  generalized  inverse 
filter;  We  show  that  the  theoretical  expression  for  the 
average  number  of  zeros  in  the  transform  space  is  con¬ 
firmed  by  computer  simulation. 

In  this  paper  we  present  in  Sec.  2  a  description  of  the 
imaging  model  including  the  functional  form  of  the 
impulse  response  and  the  corresponding  transfer  fiinc- 
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tion.  In  Sec.  3  results  are  presented  for  the  blurring 
process  as  well  as  the  recovery  of  a  pictorial  image  that 
has  been  blurred  by  a  25-point  impulse  response.  It  is 
shown  that,  provided  the  positions  of  the  impulses  are 
known  precisely,  excellent  reconstructions  are 
obtained.  The  discrete  nature  of  the  zeros  in  the  transfer 
function  is  demonstrated  in  Sec.  4  as  well  as  the  outline 
of  a  theoretical  calculation  of  the  average  number  of 
zeros  per  area  of  the  random-walk  transfer  function 
corresponding  to  the  MPIR.  A  plot  of  the  average  num¬ 
ber  of  zeros  per  area,  comparing  the  theoretical  calcu¬ 
lation  and  experimental  results,  is  presented  for  the  case 
where  the  impulses  are  uniformly  distributed  within  a 
square  window  [4,5].  The  results  presented  in  Sec.  5 
for  the  coding  and  decoding  of  a  textual  image  blurred 
by  a  50-point  impulse  response  illustrate  that  the  fact 
that  the  I^IR  may  be  used  to  obscure  an  image  beyond 
recognition  and  that  with  knowledge  of  the  coding  key 
the  original  data  may  be  recovered. 

2.  Multiple-point  impulse  response  functions 

Consider  an  object  having  an  intensity  described  by 
the  function /(x,  y)  where  (x,  y)  are  the  spatial  coor¬ 
dinates.  This  scene  is  blurred  in  a  controlled  manner 
by  convolution  with  a  blurring  function  b(x,  y),  also 
known  as  the  point  spread  function  ( psf) .  The  intensity 
of  the  blurred  image  g(x,  y)  for  a  linear  system  is  given 
by 

y)  y)  *b{x,  y)  +n(x,  y) ,  ( 1 ) 

where  the  asterisk,  * ,  represents  the  two-dimensional 
convolution  operator  and  n(x,  y)  is  an  additive  noise 
term. 

By  taking  the  Fourier  transform  of  Eq.  ( 1 ),  the  spa¬ 
tial-frequency  representation  for  the  blurred  image  is 
given  by 

G{u,v)=F<^u.v)B(u,v)+mu,v),  '  (2) 

where  upper  case  functions  represent  the  two-dimen¬ 
sional,  spatial,  Fourier  transforms  of  their  lower  case 
counterparts,  and  (u,  u)  are  the  spatial  frequency  coor¬ 
dinates  corresponding  to  the  spatial  coordinates  (x,  y) 
respectively.  B(u,  v)  is  the  transfer  function  for  the 
system.  The  image  recovery  problem  is  then  to  obtain 
a  reasonable  estimate,/(x,  y) ,  of  the  original  scene/(x, 
y)  given  g(x,  y),  the  observed  image,  and  S(x,  y) ,  an 


estimate  of  the  blur  function  b(x,  y).  Herein  the  caret 
C)  is  used  to  designate  an  estimate  of  the  named  func¬ 
tion.  Errors  between  the  original  object /(x.  v)  and  the 
recovered  estimate  /(x,  y)  may  arise  from  several 
sources  [6] .  The  sources  of  error  of  most  interest  to  us 
regarding  the  MPIR  are  errors  made  in  the  determina¬ 
tion  of  the  point  spread  function,  b(x,  y),  as  well  as 
errors  due  to  those  regions  in  the  transform  domain 
where  the  recorded  image  spectrum  is  zero.  The  arti¬ 
facts  introduced  by  these  errors  have  been  studied  [4] 
and  will  be  reported  in  a  separate  publication. 

Our  central  interest  is  the  recovery  of  intensity 
images  that  have  been  blurred  by  a  system  character¬ 
ized  by  a  multiple-point  impulse  response,  b(x,  y ) .  This 
impulse  response  consists  of  a  number,  N,  of  irregularly 
positioned  impulses  and  is  defined  by 

b(x,y)‘‘  a„S(x-x„,y-y„) ,  (3) 

I 

where  6(jc,  y)  is  the  two-dimensional  Dirac  delta  func¬ 
tion  [7] .  This  particular  blur  function  represents  a  set 
of  N  impulses  with  amplitudes  a„  and  positions  (x„, 

.  The  transfer  function  corresponding  to  this  multi¬ 
ple-point  blur  function  is 

N 

B(u,  i>)  =  £  a„exp[  -i2ir(ux„  -f  vy„)  ]  ,  (4) 

#1*  1 

where  i^=  - 1.  One  notices  inunediately  the  random- 
walk  nature  of  this  transfer  function.  We  may  consider 
the  transfer  function  at  spatial-frequency  coordinate  ( u , 
v)  to  be  comprised  of  a  sum  of  Af  complex  phasors  with 
the  amplitude  of  the  nth  phasor  being  a„  and  its  phase 
angle  27r(j«„-l-i>y„). 


3.  Image  degradation  and  recovery 

We  now  present  the  results  of  blurring  an  original 
scene  with  an  MPIR  of  the  form  given  by  Eq.  (3)  as 
well  as  reconstruction  results  using  a  generalized 
inverse  filter  algorithm.  The  MPIR,  shown  in  Fig.  1, 
consists  of  25  unit  amplitude  impulses  positioned 
within  a  64  X  64  pixel  region,  centered  on  the  origin. 
The  positions  of  Ae  impulses  are  chosen  from  a  com¬ 
puter  generated  ensemble  of  uniformly  distributed  ran¬ 
dom  numbers.  The  original  8  bits/pixel  object  scene  is 
blurred  by  the  MPIR  and  quantized  to  8  bits/pixel,  thus 
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Fig.  i.  MPIR  consisting  of  25  {>oints,  irregularly  positioned  within  a 
64  X  64  pixel  window.  The  image  has  been  enlarged  and  the  grey 
levels  inverted  (black «=  255)  to  show  detail. 


Fig.  2.  Blurred  image  using  the  25-point  impulse  response  function 
.shown  in  Fig.  I .  The  original  scene  contains  256  X  256  pixels. 


introducing  quantization  noise.  It  has  been  found  for 
the  MPIR  that  quantization  results  in  noise  that  is 
approximately  20dB  below  the  signal.  The  blurred 
image  is  shown  in  Fig.  2.  The  original  object  scene  has 
been  zero-padded  to  eliminate  truncation  artifacts  [6] , 


which  would  result  if  the  blurred  image  was  restricted 
to  the  same  number  of  pixels  as  the  original  scene.  One 
can  see  from  this  figure  that  the  2S-point  impulse 
response  has  obscured  the  fine  details  of  the  image  and 
that  the  original  object  is  no  longer  distinguishable.  The 
recovered  image  shown  in  Fig.  3  is  an  excellent  rep¬ 
resentation  of  the  original  object,  having  an  rms  error 
of  approximately  two  percent.  Similarly  good  recon¬ 
structions  are  obtained  for  50  impulses  within  the  same 
64  X  64  pixel  window,  as  well  as  for  100  and  200 
impulses. 

The  method  used  to  recover  the  object  scene  is  a 
generalized  inverse  filter  where  the  filter  operator  P(  w, 
i;)  is  described  by 


/>(«,  v)G(u. 


G(u,  v) 

V)  ’ 


10. 


B(m,  i;)#0, 
J?(«,  v)^0, 


(5) 


where  ^(m,  v)  is  an  estimate  of  the  spatial  Fourier 
transform  of  the  blur  function.  It  is  well  known  that  the 
direct  solution  of  Eq.  (2)  leads  to  an  ill-posed  problem 
and  thus  some  means  of  regularization  must  be  incor¬ 
porated  [8,9].  It  is  also  clear  that  the  filter  described 
by  Eq.  (5)  is  only  weakly  regularized.  Due  to  the  small 


Fig.  3.  Reconstructed  image  using  a  generalized  inverse  filter  cor¬ 
responding  to  the  psf  of  Fig.  I  and  defined  in  Eq.  (5).  This  scene 
contains  256  X  256  pixels. 
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values  of  B{u,v),  any  errors  in  determining  either  G(m, 
v)  or  B{u,  v)  in  the  neighborhood  of  a  zero  become 
greatly  amplified  resulting  in  the  so-called  data-discon- 
tinuity  problem  where  smalt  perturbations  in  the  data 
result  in  large  errors  in  the  reconstruction.  This  problem 
is  particularly  important  when  the  zeros  of  the  transfer 
function  form  continuous  contours  [6]  and  thus  few 
problems  can  be  solved  using  such  an  algorithm. 

Before  turning  to  a  discussion  of  the  zeros  of  the 
random-walk  transfer  function  and  a  practical  appli¬ 
cation  of  the  MPIR,  let  us  illustrate,  using  two  common 
examples  for  b{x,  y),  the  typical  deleterious  effects  of 
encountering  zeros  and  small  values  in  the  transfer 
function  when  using  the  inverse  filter.  While  no  doubt 
well-known  to  researchers  in  the  held,  the  image 
retrieval  is  so  poor  in  a  typicafcase  that  it  is  difficult  to 
find  illustrative  examples  in  the  literature.  In  the  para¬ 
graphs  below  we  present  the  recovery  results  for  a 
square  impulse  response  and  a  Gaussian  blur  using  the 
generalized  inverse  filter  of  Eq.  (5 ) . 

The  case  for  which  b(x,  y)  is  a  square  blur  function 
yields  a  transfer  function  given  by 

^  sin(7rL^)  sin(7rL,u) 

B(u,  v)  - - ,  (6) 

ITU  m 

which  contains  zeros  for  u  =  m/L,  and  v  =  n/ Ly,  where 
m  and  n  are  integers.  Shown  in  Figs.  4a  and  4b  are  the 
degraded  and  restored  images  for  the  case  where  the 
blur  function  is  a  6  X  6  square.  The  noise  amplification 
due  to  the  small  values  of  the  transfer  function  in  the 
neighborhood  of  the  zero  contours  is  clearly  seen  as 
strong  periodic  artifacts  in  the  recovered  image.  A  more 
subtle  illustration  of  the  need  for  regularization  is  given 
by  the  case  when  the  impulse  response  is  a  Gaussian. 
Shown  in  Figs.  4c  and  4d  are  the  degraded  and  restored 
images  when  the  blur  function  is  a  Gaussian  with  a 
standard  deviation  of  5  pixels.  In  this  case  the  transfer 
function  has  no  zeros,  and  yet  even  for  this  relatively 
small  amount  of  degradation  the  generalized  inverse- 
filter  result  in  Fig.  4d  is  dominated  by  noise  and  is 
markedly  poorer  than  the  original  degraded  scene. 

It  is  clear  from  Figs.  4a  and  4c  that  the  amount  of 
visual  degradation  introduced  by  the  square  and  Gaus¬ 
sian  psfs  is  considerably  less  than  for  the  case  of  the 
2S-point  MPIR.  The  reconstructions  shown  in  Figs.  3, 
4b,  and  4d  accentuate  the  excellent  results  obtained  for 
the  MPIR,  and  serve  to  delineate  the  remarkable  ability 
of  the  generalized  inverse  filter  to  recover  the  original 


scene  for  multiple-point  impulse  response  degrada¬ 
tions.  They  also  illustrate  the  importance  of  understand¬ 
ing  the  structure  of  the  zeros  in  the  transfer  function 
and  the  role  the  zeros  have  in  the  application  of  recon¬ 
struction  algorithms. 


4.  Zeros  of  the  transfer  function 

An  important  property  of  the  random- walk  transfer 
function  is  that  the  zeros  occur  at  discrete  spatial  fre¬ 
quencies.  This  property  is  illustrated  in  Figs.  5  and  6. 
The  zero  contours  for  the  real  and  imaginary  parts  of 
the  transfer  function  are  shown  in  Figs.  Sa  and  5b 
respectively.  It  is  obvious  that  the  zero  contours  form 
closed,  continuous  curves  as  is  expected  for  the  inter¬ 
section  of  the  three-dimensional  surfaces  R{u,v)  and 
X(u,  v)  with  the  zero-plane.  On  the  other  hand,  the 
zeros  of  the  transfer  function  occur  at  the  intersection 
points  of  these  two  sets  of  curves.  The  zeros  of  the 
transfer  function  are  shown  in  Fig.  6a,  with  an  enlarged 
view  of  the  inset  shown  in  Fig.  6b.  From  Figs.  6a  and 
6b,  it  is  seen  that  the  zeros  of  the  transfer  function  do 
indeed  occur  at  discrete  points. 

Since  the  zeros  of  the  transfer  function  are  discrete, 
they  are  countable.  Isolated  zeros  have  been  reported 
in  the  literature  on  crystallography  [  10,1 1  ]  and  acous¬ 
tics  [  12],  and  there  has  been  important  consideration 
of  isolated  zeros  in  speckle  patterns,  [  13,14].  However 
calculation  of  the  average  number  of  zeros  per  area  for 
the  specific  case  of  the  zeros  of  the  random  walk  of  Eq. 
( 3 )  has  not  been  found.  Herein  we  present  the  essential 
details  of  this  calculation. 

As  seen  from  Eq.  (3),  the  transfer  function  B(u,  v) 
is  in  general  a  complex  function  which  can  be  rewritten 
as 

B(«,  u)  ’^R(u,  v)  -biX(H,  v)  ,  (7) 

where  R(u,  v)  and  X(u,  v)  are  the  real  and  imaginary 
parts  of  the  transfer  function  respectively.  Baranova  et 
al.  [13]  have  presented  an  interesting  expression  for 
the  average  number  of  zeros  per  area,  M,  of  a  complex 
function,  which  in  a  suitable  form  is  given  by 

6[R(«,i;)]  6[X(k,  i>)]  dRdAr^.  (8) 
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Fig.  4.  Blurred  and  recovered  images  for  common  psfs  using  the  generalized  inverse  filter,  (a)  The  degraded  Image  using  a  6X6  pixel  square 
psf.  (b)  The  generalized  inverse  filter  result  for  (a),  (c)  The  degraded  image  using  a  Gaussian  psf  with  a  4-pixel  standard  deviation,  (d)  The 
generalized  inverse  filter  result  for  (b).  ^  ' 


where  the  integral  is  taken  over  a  prescribed  area  j/. 
The  bracket  notation  (...)  is  used  to  denote  an  average 
over  an  ensemble  of  realizations.  This  expression  can 
be  seen  to  count  the  number  of  zeros  in  the  transfer 
function,  since  the  integrand  is  nonzero  only  when  both 
the  real  and  imaginary  parts  of  the  transfer  function  are 
simultaneously  zero,  in  which  case  the  value  of  is 
incremented  by  one.  After  making  a  change  of  variables 
from  R  and  X  to  the  real  variables  u  and  v  and  applying 


the  definition  of  ensemble  average,  Eq.  (8)  can  be 
written  as 

j  ...  j  8[R(,u,  V)]  8[X(u,  V)]  \J\ 

X,  Rm  ■X.* 

XdRdXdR^6R„dX^  dX„  du  dv .  (9) 

InEq.  (9).  |7|  is  the  transformation  Jacobian, 
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(a) 


Fig.  5.  (a)  Zero>contour  plot  for  the  real  part  of  a  random^wallc 
transfer  function.  Only  the  upper  half-plane  (t;>0)  is  shown,  (b) 
Zero-contour  plot  for  the  imaginary  part  of  the  same  random-walk 
transfer  function  as  in  (a).  Again  only  the  upper  half-plane  (t)>0) 
is  shown.  The  real  and  imaginary  parts  are  real-valued  functions  and 
the  zero  contours  form  continuous,  closed  curves. 


(10) 


and  p5(...)  is  the  sixth  order  joint  density  function  of 
the  enclosed  variables,  /?,  X,  and  The 

notation  J  is  used  to  represent  all  of  the  integrals 
corresponding  to  the  differentials  in  the  integrand  taken 
over  appropriate  intervals.  It  is  a  straightforward  exer¬ 
cise  to  reduce  Eq.  (9)  to  a  one-dimensional  form 
(dropping  X  and  u)  and  obtain  a  result  equivalent  to 
Rice’s  [  IS]  result  for  the  expected  number  of  zeros  of 
a  random  noise  current. 

In  order  to  evaluate  Eq.  (9),  an  expression  for  the 
joint  density  function,  P6(...),  is  ne^ed.  The  sixth 
order  joint  density  function  can  be  simplified  to  a  prod¬ 
uct  of  first  order  density  functions  provided  it  can  be 
shown  that  the  fields  and  their  first  partial  derivatives 
obey  Gaussian  statistics  and  are  all  mutually  uncorre¬ 
lated.  It  is  well  known  that  the  statistics  of  the  random- 


walk  are  asymptotically  Gaussian  [16-18].  For  the 
case  of  a  small  number  of  scatterers  (a  small  number 
of  steps  in  the  random-walk),  it  is  known  that  the  two- 
dimensional  random  walk  does  not  obey  Gaussian  sta¬ 
tistics  [19-21].  The  regime  in  which  the  statistics 
begin  to  become  Gaussian  has  been  found  to  be  1 
[21,22].  It  is  readily  found  for  typical  cases,  where 
N  >  20,  that  the  real  and  imaginary  parts  of  the  transfer 
function  are  well  approximated  by  Gaussians  [4] .  The 
fact  that  the  real  and  imaginary  parts  of  the  transfer 
function  are  Gaussian  ensures  that  the  first  partial  deriv¬ 
atives  are  also  Gaussian  [  17] . 

If  the  field  components  can  be  shown  to  be  mutually 
uncorrelated,  then,  since  each  component  obeys  Gaus¬ 
sian  statistics,  the  sixth  order  joint  density  function  may 
be  simplified  into  the  product  of  the  first  order  density 
functions  of  each  component.  While  the  details  of  the 
derivation  are  not  presented  here,  it  can  be  shown  that 


Fig.  6.  (a)  Zero-contour  plot  for  the  random-walk  transfer  function 
corresponding  to  Fig.  5a  and  5b.  Only  the  upper  half-plane  {v>0) 
is  shown.  The  transfer  function  is  a  complex-valued  function  and  the 
zero  contours  are  formed  by  the  intersection  of  the  two  sets  of  con¬ 
tinuous,  closed  curves  shown  in  Fig.  5.  The  zeros  occur  at  isolated 
points,  (b)  An  exploded  view  of  the  inset  region  of  (a). 
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all  field  components,  R(u,  u),  X{u,  v),  /?„(«,  y),  etc., 
are  mutually  uncorrelated  provided  the  region  of  inter¬ 
est  in  the  transform  domain  is  restricted  to  those  spatial 
frequencies  where  the  characteristic  function  of  the 
positions  of  the  multiple-point  impulses  is  negligible. 
It  is  also  required  that  the  impulses  be  distributed  such 
that  the  ‘center  of  mass’  of  the  impulses  is  located  at 
the  origin.  Under  these  assumptions,  the  sixth  order 
joint  density  function  is  rewritten  as 


Pe(Ry  X,  Ryj  Xyf  /?,»,  X^) 

(11) 


where  the  notation ( z)  represents  the  first  order  Gaus¬ 
sian  density  function  for  the  random  variable  z.  Substi¬ 
tuting  appropriate  expressions  for  the  Gaussian  density 
functions  into  Eq.  ( 1 1 )  and  the  result  into  Eq.  (9),  the 
expression  for  the  average  number  of  zeros  becomes 

j  ...  j  6(Jt)S(X)lJlp„(Ji)Px(X) 


XdJidXdR„  dR,.  dX„  dX,.  du  dv 


1  f  j-  8(R)S(X)IJI 

(2ir)^  J  ■  J  <rx<Tn,a-K^(Tx(Tx.<rx. 


Xexpj 

Xexp 

Xexp 


(R-Px)^  (X-tix)n 

2(t%  2tri  J 
20-1,  2(tI,  j 


XcW...dX,,  du  du , 


>  (12) 


where  it  is  not  assumed  that  the  field  components  are 
zero-mean  and  the  spatial-frequency  dependence  of  the 
variances  cr^,  o*x»  etc.,  has  been  retained,  although 
not  explicitly  shown.  Satisfying  the  conditions  for 
which  the  field  components  are  uncorrelated  also 
assures  that  each  component  is  in  fact  zero-mean,  the 
variances  are  independent  of  the  spatial  frequencies  u 
and  u,  and  (Tr^<7x.  There¬ 

fore  the  average  number  of  zeros  may  be  written  as 


Xexp 
Xexp 

XdRdXdR„dR,dX„dX„dudu.  (13) 

It  is  noted  that  we  have  made  the  assumption  that  either 
the  characteristic  function  for  the  impulse  positions  is 
delta-like  or  that  we  are  restricting  the  range  of  inte¬ 
gration  to  those  frequencies  for  which  the  characteristic 
function  is  negligible. 

Eq.  ( 13)  is  readily  evaluated  to  give 


R^+X^W 

,  2al  jj 

Rl+Xl 

»  2o’»„  2o’i  /  J 


^  Ry^  Rv 

l'rTa\ 


(14) 


for  the  average  number  of  zeros  per  area.  In  those 
regions  of  the  transform  domain  where  the  character¬ 
istic  functions  of  the  positions  of  the  impulses  are  neg¬ 
ligible,  the  variances  are  given  as 


O'!  =  ^ .  O’!. = ,  o-^ = , 

(15) 

and  the  average  number  of  zeros  per  area  becomes 

=2W<J^><yJ>  . 

(16) 

where  (ji^)  is  the  second  moment  of  the  jc-coordinate 
of  the  impulse  positions  and  (3^)  is  the  corresponding 
second  moment  of  the  y-coordinates. 

If  it  is  assumed  that  the  impulses  are  uniformly  dis¬ 
tributed  within  a  rectangular  window  of  size  W,X  Wy, 
then  the  average  number  of  zeros  per  area  is 

A/«(7r/6)W,Wy.  (17) 

It  is  noteworthy  that  this  expression  for  the  average 
number  of  zeros  per  area,  Af,  is  independent  of  N,  the 
number  of  impulses  in  the  blur  function.  Rather  the 
average  number  of  zeros  is  governed  by  the  distribution 
of  the  impulses. 

Fig.  7  contains  a  plot  of  the  number  of  zeros  of  the 
transfer  function  versus  the  area  of  the  window  enclos- 
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Fig.  7.  Dependence  of  the  average  number  of  zeros  per  unit  area  for 
the  random-walk  transfer  function  on  the  size  of  the  window  enclos¬ 
ing  the  impulses.  The  solid  curve  is  the  theoretical  result  obtained 
from  Eq.  (16)  and  the  dashed  curve  is  the  best-fit  result  for  the 
experimental  data  points  shown  as  the  symbols.  Note  that  the  average 
number  of  zeros  is  independent  of  the  number  of  impulses  in  the  blur 
function. 

ing  the  impulses.  Included  in  the  plot  are  the  experi¬ 
mental  results  for  six  values  of  the  area,  the  theoretical 
estimate  from  Eq.  (17),  and  a  minimum  chi-squared 
fit  [23]  to  the  experimental  data  using  the  expression 

curve  fit=  “  ♦  (18) 

where  the  best-fit  value  of  a  was  found  to  be  5.8  as 
opposed  to  the  value  of  6.0  of  Eq.  ( 17).  It  is  seen  in 
this  plot  that  there  is  excellent  agreement  between  the 
theoretical  calculation  and  experimentally  obtained 
results. 

An  important  result  of  this  research  is  realizing  that 
there  is  a  small  likelihood  of  encountering  a  zero  when 
sampling  the  transfer  function  for  the  image  recovery 
process.  Hence  it  is  worthwhile  to  consider  an  approx¬ 
imate  illustrative  calculation  of  the  probability  per 
frame  of  encountering  a  zero  in  the  transfer  function. 
For  the  image  recovery,  consider  sampling  the  transfer 
function  on  a  lattice  of  5 1 2  X  5 1 2  pixels  and  the  frame 
to  be  of  unit  area.  If  due  to  noise  fluctuations,  we  take 
the  transfer  function  B(/^,/,.)  to  be  zero  in  a  tiny  region 
around  each  discrete  zero,  i.e.,  an  infinitesimal  area 
A/,  X  A/,,  that  is  (2X  10“^)“,  then  the  probability,  P, 
of  encountering  a  zero  is  approximately 

P«Af(512)^(2XI0“'^)^  (19) 


where  M  is  the  average  number  of  zeros.  In  the  blurred 
bird  of  Fig.  2,  the  blur  function  impulses  were  enclosed  '' 
in  a  window  of  size  64X64  pixels.  From  the  curve 
shown  in  Fig.  7,  there  will  be  approximately  1200  zeros 
in  the  transform  space  and  therefore  the  probability,  of 
encountering  a  zero  is  given  by 

P«2200(512)^(2X  10“®)^=  1/433  .  (20) 

Thus,  for  this  case,  a  zero  will  be  encountered  in  the 
transform  domain  once  in  every  433  frames.  In  a  typical 
set  of  computer  simulations  (50  different  MPIR).  we 
recover  images  of  the  high  quality  shown  in  Fig.  3. 


.  .  .  •  r}..  !.'»■  r*.-  ' 


■<»:a 


Fig.  8.  Text  image  blurred  with  a  56point  impulse  response.  The 
original  image  contains  512x  1024  pixels  and  the  text  is  no  longer 
readable. 
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5.  Coding  of  textual  images 

To  investigate  the  effects  of  blurring  textual  images, 
an  independent  MPIR  was  used  to  construct  the 
blurred /coded  image  of  Fig.  8.  In  this  experiment  a 
page  of  text  is  digitized  and  blurred  using  a  50-point 
MPIR.  The  positions  of  the  impulses  are  restricted  to 
lie  within  a  64  X  64  pixel  window  centered  on  the  origin 
and  are  chosen  from  a  computer  generated  ensemble  of 
uniformly  distributed  random  numbers.  One  can  see 
that  the  MPIR  has  coded  the  text  beyond  recognition. 
The  reconstructed  image,  using  the  appropriate  gener¬ 
alized  inverse  filter,  is  shown  in  Fig.  9.  There  is  only 

LINCOLN'S  GETTYSBl  IRC  ADDRESS 

"Fourscore  and  seven  years  ago  our  fathers  brought 

forth  on  this  continent  a  new  nation,  conceived  in  liberty, 

and  dedicated  to  the  proposition  chat  all  men  are  created 

equal.  Now  we  are  engaged  in  a  great  civil  war,  testing 

whether  that  nation,  or  any  nation  so  conceived  and  so 

dedicated,  can  long  endure.  We  are  met  on  a  great  banle- 

field  of  that  war.  We  have  come  to  dedicate  a  portion  of 

that  field,  as  a  final  resting  place  for  those  who  here  gave 

their  lives  that  that  nation  might  live.  It  is  altogether 

fitting  and  proper  that  we  should  do  thi.s.  But,  in  a  larger 

sense,  we  cannot  dedicate — we  cannot  consecrate — we 

cannot  hallow — this  ground.  The  brave  men,  living  and 

dead,  who  .struggled  here,  have  consecrated  it,  far  above 

our  poor  power  to  add  or  detract.  The  world  will  little 

note,  nor  long  remember,  what  we  say  here,  but  it  can 

never  forget  what  they  did  here.  It  i.s  for  us  the  living, 

rather,  to  be  dedicated  here  to  the  unfinished  work  which 

they  who  fought  here  have  thus  far  so  nobly  advanced. 

It  is  rather  for  us  to  be  here  dedicated  to  the  great  task 

remaining  before  us, — that  from  these  honored  dead  we 

> '  ■ 

take  increased  devotion  to  that  cause  for  which  they  gave 
the  last  full  measure  of  devotion — that  we  here  highly  re¬ 
solve  that  these  dead  shall  not  have  died  in  vain — that 
this  nation,  under  God,  shall  have  a  new  birth  of  free¬ 
dom — and  that  government  of  the  people,  by  the  people, 
for  the  people,  shall  not  perish  from  the  earth." 

Fig.  9.  Text  image  reconstructed  using  an  appropriate  generalized 
inverse  filter  for  the  SO-point  impulse  response  used  to  generated 
Fig.  8.  The  original  scene  has  been  faithfully  recovered  and  the  text 
is  again  readable. 


negligible  error  between  the  original  scanned  image 
and  the  recovered  image. 

From  Figs.  2  and  8,  the  controlled  blur  is  seen  to  be 
a  technique  for  obtaining  privacy  or  coding  in  image 
transmission.  We  have  investigated  the  degree  to  which 
privacy  is  achieved  by  reconstructing  the  blurred  bird 
using  20  points  correctly  positioned  and  5  points  cho¬ 
sen  at  random.  Under  these  conditions  the  image  recov¬ 
ery  gives  barely  perceptible  results.  For  17  points 
correctly  located  and  8  in  error,  the  recovered  bird  is 
not  recognizable. 

We  have  obtained  excellent  reconstructions  of 
images  that  have  been  degraded  by  the  multiple-point 
impulse  response,  which  consists  of  irregularly  posi¬ 
tioned  impulses.  The  blurred  bird  and  the  recovery  are 
shown  in  Figs.  2  and  3,  respectively.  It  is  found  that, 
although  the  zeros  of  the  real  and  imaginary  parts  of 
the  transfer  function  form  closed,  continuous  contours, 
zeros  of  the  transfer  function  occur  at  discrete  locations 
and  do  not  have  a  deleterious  effect  on  the  reconstruc¬ 
tions. 
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Abstract 

A  theory  is  presented  for  image  retrieval  when  a  planar  transparency  is  illuminated  by  spatially  incoherent  light  that 
propagates  in  free  space  and  is  then  recotded  on  a  CCD  array,  but  without  using  an  imaging  lens.  Based  on  Maxwell’s' 
equations  and  Fourier-optical,  linear-systems  theory,  equations  are  derived  for  digital  processing  of  this  badly  blurred  image 
in  order  to  recover  a  reasonable  facsimile  of  the  original.  Rigorous  impulse  responses  and  their  corresponding  transfer 
functions  are  presented  for  the  cases  of  general  amplitude  illumination  and  for  incoherent  illumination. 


1.  Introduction 

Image  processing  methods  have  been  applied  to 
remove  blur  due  to  motion,  degradation  due  to 
diffraction  limits,  and  blur  due  to  poor  focus  [1,2]. 
As  computing  power  has  increased,  these  methods 
are  being  more  widely  applied  to  include  correction 
for  known  aberrations  and  image  recovery  using 
partial  information  [3].  A  recent  study  showed  that 
blur  caused  by  an  impulse  response  consisting  of 
irregularly  spaced  impulses  could  be  completely  re¬ 
moved  [4,5].  Since  the  corresponding  transfer  func¬ 
tion  contains  only  discrete,  countable  zeros,  it  is 
found  that  either  a  simple  inverse  filter  or  a  Weiner- 
Helstrom  filter  [6]  yields  good  results. 

In  this  paper  we  consider  the  feasibility  of  image 
recovery  when  the  image  blur  is  due  to  diffraction 
spreading  through  open  space  without  the  use  of  a 


‘  E-mail:  ngeorge(§troi.cc.rochestenedu. 


lens,  as  in  Fig.  1.  Restating,  we  consider  whether  it 
is  possible  to  retrieve  an  image  at  a  remote  location 
from  an  incoherently  illuminated  object  transparency 
that  is  located  in  the  plane  at  z  =  0.  No  lens  is  used 
for  forming  an  image,  and  the  badly  blurred  record¬ 
ing  is  made  electronically  by  a  CCD  array  at  a 
distance  d.  For  the  theory,  an  analytic  signal 

notation  is  used  so  that  signals  of  arbitrary  band¬ 
width  can  be  included,  and  traveling  waves  appear  in 
an  exponential  form.  We  consider  a  plane-polarized 
scalar  component  of  the  real-valued  electric 


Hg.  1.  Basic  setup  for  the  theory  showing  an  input  transparency 
y)  in  the  plane  2*0.  The  output  intensity  is  recorded  at 
2  -  after  lensless,  free-space  propagation. 
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field,  denoted  by  y,  z;  t).  Time  truncation 

rect(r/r)  is  used  so  the  temporal  Fourier  transform, 
y,  z;  v),  is  defined  by 

Ey{  X,  y,  z;p)^J  r('>(  X,  y,  z;  r) 

Xrect(  r/r)  exp(-i27ri'r)  dr, 

(1) 

where  (x,  y,  z)  are  Cartesian  coordinates  for  an 
arbitrary  point,  v  is  the  temporal  transform  variable, 
and  the  Urn  r-»  *  notation  is  implicitly  understood. 
TTie  signal  representations  used  in  this  paper  follow 
closely  that  in  the  literature  and  are  reviewed  more 
fully  in  Refs.  [7,8]  in  the  context  of  diffraction 
integrals  based  on  Maxwell’s  equations.  From  Eq. 
(1),  the  corresponding  analytic  signal,  denoted  by  the 
subscript  ‘a’  in  £y,(x,  y,  z:  p),  is  defined  as  con¬ 
taining  only  the  positive  frequency  components  as 
follows; 

Ey,{x,  y,  z;  p)’=E,{x,  y,  z;  »')[l  +  sgn(i/)]. 

(2) 

The  symmetrical  step-function,  sgn(i/)  is  defined  by 
sgn(  v)  =  1 ,  when  i/>  0, 

«=  - 1,  when  i><0.  (3) 

From  the  Fourier  inversion  formula  and  Eq.  (2),  we 
can  write  the  time-dependent  analytic  form 
y,  z,  t)  corresponding  to  as 

y,  z,  t)  J  ^£j„(x,  y,  z;  p) 

Xcxp(+i2irpt)  Ap. 

One  can  also  readily  verify  a  well-known  alternative 
equation  that  is  handy  for  computing  y,  z,  t) 
from  the  analytic  form,  viz., 

i^/\x,y,z,t) 

“  y.  Z.  0  +^y\{x,  y,  z.  r)]/2.  (4) 


2.  Linear  system  theory  and  diffraction  integrals 

Now  for  the  problem  at  hand,  as  shown  in  Fig.  1, 
we  will  shortly  see  that  it  is  possible  to  provide  an 
exact  solution  of  Maxwell’s  equations  using  die  ide¬ 


alizations  inherent  in  the  model.  Using  the 
Rayleigh-Sommerfeld-Smythe  form  for  the  radiation 
in  the  right-half-space  expressed  in  terms  of  the 
“known”  tangential  electric  field  in  the  plane  at 
Z“0,  we  can  write  the  exact  solution,  as  follows 
[8,9]: 

Eyyf^x,  y,  z;  p) 


— //dx'dy£,.(x',y,0;  p) 


exp(-ikR,)f  z 


in  which 


(5) 


-y)'+z!j''’,  (6) 

and  k’-lvp/c  where  c  =  3x  10®  m/s.  One  can 
write  a  similar  equation  for  E,,(x,  y,  z;  p)  in  terms 
of  E^/x*,  y,  0;  p)  and  then  a  separate  form  for 
Ej,(x,  y,  z;  p)  in  terms  of  the  tangential  aperture 
fields  E„(y,  y,  0;  p)  and  E^.(x',  y,  0;  p).  These 
three  equations  for  Ey^,  and  comprise  an 
exact  solution  in  integral  form  for  Maxwell’s  equa¬ 
tions  for  radiation  from  a  planar  aperture.  Eq.  (5) 
forms  the  basis  for  the  calculation  of  radiation  from 
an  aperture.  Typically  one  considers  a  blocking  func¬ 
tion  and  the  source  illumination  which  are  implicit  in 
the  scalar  component  of  the  electric  field  in  die 
aperture,  E^/x',  y,  0;  p). 

The  linear  ,  system  interpretation  of  Eqs.  (5)  and 
(6)  is  to  notice  that  the  output  scalar  amplitude  is 
given  by  a  convolution  of  the  input  scalar  amplitude 
with  the  impulse  response  A(x-x',  y-y;  p). 
Hence,  we  can  write  that 


h(x-x:,  y-y;  v) 
exp(-i*E,) 


2‘irE| 


(7) 


in  which  E,  is  given  by  Eq.  (6).  Since  this  impulse 
response  is  space-invariant,  we  write  the  following 
simpler  form: 


fr(x,  y;  v) 


exp(-ikEo) 

2vRq 


in  which  the  distance  to  x,  y,  z  from  the  origin,  Eq, 
is  given  by 


Ro’-ix^+y^  +  z^y'\ 


(9) 
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Consider  an  input  transparency  p{x,  y)  placed  in 
the  plane  at  z  =  0  and  illuminated  by  a  plane- 
polarized  beam  EyJ,x!,  y\  O';  v)  incident  from 
the  left  in  Fig.  1.  Making  the  usual  Kirchhoff  ap¬ 
proximation,  we  set  y,  0;  v)  as  follows: 

y.O;  v)=pix,  y)  /.O":  »')• 

(10) 


For  incoherent  illumination,  we  briefly  summarize 
the  calculation.  Denoting  the  blurred  output  scene 
recorded  at  z»</  by  MjCx,  y;  if),  we  calculate  the 
expected  value  of  the  density  of  energy  in  the  elec¬ 
tric  Held  over  an  ensemble  of  sources,  viz.. 


y;  >') 


r--  \  T  I 

(H) 

4 

The  source  description  for  incoherent  illumination  is 
given  by  a  delta-function  form  as  follows: 


lim 

T*-*  00 


^E„o(y,y,0-;  v)£,.o(y>,/.0-;  v)j 

5(y-y')5(y-/)s,(i/),  (12) 


in  which  the  input  illumination  spectral  density  S^{v) 
is  defined  by  an  ensemble  average  over  the  sources 
as 


^i(>') 


lim/! 

\ 


y.0~;  i')!^  4 


(13) 


in  which  Ag  is  an  infinitesimal  area  of  coherence. 
The  blurred  image  recorded  at  the  CCD  is  given  by 
calculation  of  Eq.  (1 1)  substituting  Eqs.  (S)  and  (12) 
and  integrating  over  the  input  plane.  In  a  linear 
system  formalism,  we  write  the  blurred  image 
recorded  at  the  CCD  array  (z  as  a  convolution 
of  the  input  picture  intensity  transmittance  with  the 
impulse  response  for  incoherent  illumination.  The 
result  is  given  by 


«2(jc.  y'f  v)~p(x,  y)p'ix,  y)*h(x,  y;  d) 

Xh‘(x,  y,  d)So{v),  (14) 

where  the  asterisk  *  denotes  a  two-dimensional 
convolution  over  (x,  y). 


Interestingly,  by  Eqs.  (8)  and  (9)  into  (14),  we 
find  the  exact  expression  for  the  impulse  response 
due  to  free  space  propagation  from  an  incoherently 
illuminated  planar  aperture,  as  follows; 

|A(x,  y,  d;  v)\^ 


f-1 

\ 

\2ir, 

'  {x^+y^  +  d^f 

(15) 


The  exp(  — iWfj)  terms  in  Eq.  (5)  have  cancelled  due 
to  the  delta  correlation  of  the  source.  Hence,  in  Eqs. 
(14)  and  (15)  the  solution  is  not  limited  to  the  usual 
paraxial  and  z^distance  limitations  inherent  in  the 
Fresnel-zone  case  [10].  Moreover,  we  recognize  in 
Eq.  (15)  that  the  first  member  on  the  right  (it^)  is  the 
dominant  term  in  the  propagation  once  we  are  a  few 
wavelengths  from  the  aperture.  The  second  term 
[l/(x^  +  rf^)]  is  the  near  zone  term  and  it  is 

important  in  the  limiting  case  as  z  goes  to  zero,  say, 
in  Eq.  (5). 


3.  Image  recovery  for  free-space  propagation 

In  Fourier  optics  with  incoherent  illumination, 
one  characterizes  a  space-invariant  linear  optical  sys¬ 
tem  by  an  impulse  response  and  a  corresponding 
optical  transfer  function.  The  Fourier  transform  of 
the  blurred  picture  at  z^d  is  denoted  by 
fy\  v)  and  defined  by 
00 

fy'f  jf  d*  dy  Uj{x,  y,  v) 

—  00 

Xexp[-i27r(/,x-f/,y)],  (16) 

where  (/,,  /^)  are  spatial  transform  variables  for 
(x,y).  The  spatial  frequency  response  formula  for 
free  space  propagation  is  obtained  by  taking  the 
two-dimensional  transform  of  Eq.  (14).  The  result  is 
given  by  a  simple  product  of  the  Fourier  transform 
of  object  intensity  and  the  optical  transfer  function, 
as  follows: 

Hffff  /,;  *') 

~9-\p{x,  y)\^‘9-\h{x,  y,  d,  v)|*.So(v). 

(17) 
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Table  1 

Impulse  response  and  transfer  functions  for  free-space  propagation  from  a  planar  aperture  at  z  -  0  into  the  right-half-space.  For  the  general 
amplitude  transfer  function,  select  the  positive  square  root  when  f}  and  the  negative  imaginary  value  when  //  +/^  > 

( V2ir)^  to  include  only  damped  evanescent  waves  in  the  latter  case  ^  ^ 

System  description  Impulse  response  Transfer  function 

input 


General  case 
amplitude  input 

y;  [exp(-iW?o)/27r/?oK2//2oXi*  +  I/Rq) 

Incoherent  illumination 
intensity  case 

I  j/x,  y\  p)\^So(v)  lz^/(2n)^RiXk^  +  I/Rq) 

Notation:  /?  and  »//  +/^  ' 


exp(-i2irz((V2ir)2  -//  -//]•/') 


(*  V,  Ar,/2Xfrn^  +  (ir/;Ar2/4)(»wj^ 


in  which  the  operator  ^  denotes  the  two  dimen¬ 
sional  spatial  transform  over  (x,  y).  To  calculate  the 
Fourier  transform  of  |  A( j:,  y;  d\  v)\^  we  notice  the 
cylindrical  symmetry  in  (15)  and  obtain  the 
result  with  two  applications  of  Eq.  (6^65.4)  of  Ref. 
[11].  The  resulting  optical-transfer-fiinction  for  free 
space  propagation  from  z  =  0  to  d  is  given  by 

k^df 

y- 1  A(  X.  y;  d;  I/)  I '  =  -^Kt{2irdf^) 

+  ^K,{2^df,),  (18) 

in  which  the  cylindrical  spatial  frequency,  f^,  is 
defined  by 

4- (/,'+//)’'''■  (19) 

Ki{2‘ndf^)  and  K2(2irclff,)  are  the  modiHed  Bessel 
functions  of  the  second  kind  of  order  one  and  two, 
respectively. 

One  clearly  sees  die  dominance  of  the  first  mem¬ 
ber  in  Eq.  (18)  by  the  ratio  of  their  coefficients 
which  is  8ir<//(AVp)-  With  A-OJ  fim,  rf- 10 
mm,  4“  10  c/mm  this  ratio  is  roughly  ,10*.  It  is 
instructive  to  plot  Ar,(2ir4fp)  on  a  logarithmic  scale 
as  in  Fig.  2.  From  this,  we  see  that  K,(2v4f^)  is 
inOnite  at  the  origin  and  drops  exponentially  to  zero 
for  infinite  argument  This  is  clear  from  the  follow¬ 
ing  expressions  valid  for  small  arguments,  fiom  Eq. 
(9.6.9)  in  Ref.  [12]: 

and  Ar2(i>)  ai2/i;*,  (20) 

as  V  goes  to  zero.  By  Eq.  (20)  it  is  clear  that  the 
transfer  function  in  (18)  is  finite  as  {dfp)-*Q. 


And  at  large  values  for  their  arguments,  the  modified 
Bessel  functions  of  the  second  kind  have  the  follow¬ 
ing  expression: 

(21) 

Most  interestingly,  the  modified  Bessel  functions 
K„{v)  do  not  have  any  finite  zeros  for  real  argu¬ 
ments.  With  reference  to  Eq.  (17),  this  makes  the 
blurred  image  1/2(4, 4’  ®  P""*®  candidate  for 

image  retrieval,  i.e.,  recovering  ^\pix,  y)|*  and 
hence  the  image  intensity  \  p{x,  y)|^,  since  the 
Fourier  transform  of  the  blurring  function,  9'\h\^, 
has  no  zeros  in  the  real  frequency  plane  (4,  fy\ 
Due  to  the  absence  of  zeros  in  the  transfer  function 
but  with  the  inclusion  of  noise,  it  is  hopeful  that  the 
Weimer-Helstrom  modified  inverse  filter  would  be 
an  appropriate  start  As  pointed  out  in  our  earlier 


Fig.  2.  The  modified  Bessel  function  Jir|(2'n'4i:,)  plotted  logarith¬ 
mically  versus  the  aigumenL  The  plot  starts  at  iirdf^,  ••  t  in  order 
to  avoid  the  singularity  at  the  origin. 
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article  [5],  this  type  of  inversion  problem  to  recover 
I  p(x,  y;  v)\^  is  ill-posed,  and  it  may  well  need 
some  means  of  regularization  which  is  beyond  the 
scope  of  this  article  [13,14]. 


4.  Summary 

In  this  paper  we  have  presented  the  exact  impulse 
responses  for  free-space  propagation  into  the  right- 
half-space  from  an  idealized  planar  aperture,  see 
Table  1  and  Eqs.  (7)  and  (15)  for  the  cases  of 
amplitude  illumination  and  incoherent  illumination, 
respectively.  With  exact  results  in  the  framework  of 
Maxwell’s  equations,  we  find  that  free-space  propa¬ 
gation  from  a  planar  aperture  is  space-invariant  in 
general.  One  main  theme  is  to  derive  a  rigorous 
expression  for  the  optical-transfer-fiinction  of  free 
space,  and  thereby  secondly  to  study  the  feasibility 
of  image  retrieval  using  a  lensless  recording  system 
and  post  digital  processing.  We  find  the  interesting 
result  that  this  intensity  based  transfer  function  in 
Eq.  (18)  consists  principally  of  a  modified  Bessel 
function  of  the  second  Idnd,  K^iv\  which  is  well- 
known  not  to  have  any  zeros  for  finite  real  values  of 
its  argument  The  significance  of  this  is  that  recovery 
of  the  pictorial  image,  |  p(x,  y\  v)\^^  is  likely  using 
digital  processing  means. 
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